Machine learning for intensive care.

Chris McWilliams

Engineering Mathematics, University of Bristol and
University Hospitals Bristol NHS Foundation Trust
chris.mcwilliams@bristol.ac.uk

So I was asked to talk to you about machine learning in the context of intensive care. And I'm going to give it a go, although machine learning is only really a small part of what I currently do. I am going to give another version of this talk in a cuople of weeks, and I think it will be called: "Data driven improvements to intensive care practice." MOre accurately describes what I do..

Contents

1. Motivation.

2. What is machine learning?

3. Machine learning in practice.

4. Not even machine learning.

1. Motivation

image = Image('resources/bd2k_0.jpg', width=700)
sh = display(image)

(Friedman, 2015)

2. What is machine learning?

(https://www.coursera.org/learn/machine-learning)

image = Image('resources/expert_system.png', width=800)
sh = display(image)

(www.igcseict.info/theory/7_2/expert/)

image = Image('resources/Supervised-Learning-versus-Unsupervised-Learning-Mathworks-nd.png', width=800)
sh = display(image)

(Bunker & Thabtah, 2017)

image = Image('resources/deeplearning1.png', width=700)
sh = display(image)

(https://www.ibm.com/blogs/systems/deep-learning-performance-breakthrough/)

image = Image('resources/deep_learning_growth.jpg', width=600)
sh = display(image)

"Artificial intelligence in healthcare: past, present and future" (Jiang et al, 2017)

image = Image('resources/black_box.png', width=800)
sh = display(image)

(https://callingbullshit.org/case_studies/case_study_ml_sexual_orientation_original_version.html)

But what about interpretability?

image = Image('resources/tools_used_in_ai.jpg', width=700)
sh = display(image)

"Artificial intelligence in healthcare: past, present and future" (Jiang et al, 2017)

3. Machine learning in practice.

3.1 Deep learning: digit recongition

image = Image('resources/rfd_board_whole.png') #, width=1500)
sh = display(image)

First, data preparation..

image = Image('resources/rfd_board_template_only.png') #, width=1500)
sh = display(image)

image = Image('resources/rfd_board_elements.png') #, width=1500)
sh = display(image)

image = Image('resources/rfd_board_1_&_8.png') #, width=1500)
sh = display(image)

image = Image('resources/rfd_board_1_&_8_contoured.png') #, width=1500)
sh = display(image)

Then, machine learning...

image = Image('resources/tensor_flow_example.png', width=700)
sh = display(image)

(https://www.tensorflow.org/)

image = Image('resources/rfd_board_predictions.png') #, width=1500)
sh = display(image)

image = Image('resources/sevens.png') #, width=1500)
sh = display(image)

3.2 More deep learning examples.

image = Image('resources/eye_scan_example.png', width=500)
sh = display(image)

"Clinically applicable deep learning for diagnosis and referral in retinal disease."

(De Fauw et al., 2018)

"Only 14,884 scans...""

"Diagnostic assessment of deep learning algorithms for detection of lymph node metastases in women with breast cancer."

(Bejnordi et al., 2017)

"Interpretable Deep Models for ICU Outcome Prediction"

(Che et al., 2016)

"Recurrent neural networks for multivariate time series with missing values."

(Che et al., 2018)

Cardiac length of stay prediction:

• Litton, Edward, Michael McCann, and Frank van Haren. "Predicting Intensive Care Unit Length of Stay After Cardiac Surgery." (2018).
• Maharlou, Hamidreza, et al. "Predicting Length of Stay in Intensive Care Units after Cardiac Surgery: Comparison of Artificial Neural Networks and Adaptive Neuro-fuzzy System." Healthcare informatics research 24.2 (2018): 109-117.
• LaFaro, Rocco J., et al. "Neural network prediction of ICU length of stay following cardiac surgery based on pre-incision variables." PloS one 10.12 (2015): e0145395.

Mention Streams app. Data collection. Be sceptical of 'deep learning without enough data'

3.2 Unsupervised learning: patient subgroups

"Identifying distinct subgroups of ICU patients: a machine learning approach"

(Vranas et al, 2017)

image = Image('resources/clustering_versus_classification.png', width=700)
sh = display(image)

image = Image('resources/subgroups_table.png') #, width=1500)
sh = display(image)

"Identifying patients subtypes on the intensive care unit."

(Corrigan, Harush, Morgan, Shelim, Zulkarnaen, 2018)

Data: Physionet Challenge 2012

(https://physionet.org/challenge/2012/)

image = Image('resources/student_clusters.png') #, width=1500)
sh = display(image)

image = Image('resources/student_table.png', width=500)
sh = display(image)

3.3 Supervised learning: Patient discharge classifier

image = Image('resources/paper_title.png', width=600)
sh = display(image)

image = Image('resources/nld_criteria_original.png', width=500)
sh = display(image)

"Nurse‐led discharge from high dependency unit."
(Knight, 2003)

image = Image('resources/codified_nld.png')
sh = display(image)

"Towards a decision support tool for intensive care discharge: machine learning algorithm development using electronic health care data."

(McWilliams et al, 2019)

## thanks to: https://stackoverflow.com/questions/47637739/how-to-display-two-local-images-side-by-side-in-jupyter
## and border removal, thanks God! : https://github.com/ipython/ipython/issues/8581
display(HTML("<table style='border: 0'><tr style='border: 0'><td style='border: 0'><p style='border: none!important;'><img width='600' src='resources/time_panel_survivor_ptassess.png'></td><td style='border: 0'><img width='600' src='resources/time_panel_survivor_labres.png'></td></tr></table>"))

display(HTML("<table style='border: 0'><tr style='border: 0'><td style='border: 0'><p style='border: none!important;'><img width='600' src='resources/time_panel_mortality_ptassess.png'></td><td style='border: 0'><img width='600' src='resources/time_panel_mortality_labres.png'></td></tr></table>"))
#display(HTML("<table><tr><td><img src='resources/time_panel_mortality_ptassess.png'></td><td><img src='resources/time_panel_mortality_labres.png'></td></tr></table>"))

image = Image('resources/comparison_table.png')
sh = display(image)

image = Image('resources/cohort_table.png')
sh = display(image)

image = Image('resources/clustering_versus_classification.png', width=700)
sh = display(image)

image = Image('resources/tsne.png') #, width=1500)
sh = display(image)

image = Image('resources/figure1.png', width=1500)
sh = display(image)

image = Image('resources/performance_table_imputed.png')
sh = display(image)

image = Image('resources/fimp_table_imputed.png')
sh = display(image)

image = Image('resources/time_of_day_patterns.png') #, width=1500)
sh = display(image)

4. Not even machine learning

image = Image('resources/gicu_dash.jpg', width=300)
sh = display(image)

image = Image('resources/paper_title_2.png', width=600)
sh = display(image)

image = Image('resources/increasing_compliance.jpg', width=500)
sh = display(image)

(Friedman, 2015)

image = Image('resources/new_gicu_whiteboard.jpg', width=400)
sh = display(image)

The electronic version.

A future interactive dashboard?

References:

• Jiang, Fei, et al. "Artificial intelligence in healthcare: past, present and future." Stroke and vascular neurology 2.4 (2017): 230-243.
• Bunker, Rory P., and Fadi Thabtah. "A machine learning framework for sport result prediction." Applied Computing and Informatics (2017).
• Vranas, Kelly C., et al. "Identifying distinct subgroups of ICU patients: a machine learning approach." Critical care medicine 45.10 (2017): 1607-1615.
• Silva, Ikaro, et al. "Predicting in-hospital mortality of icu patients: The physionet/computing in cardiology challenge 2012." Computing in cardiology 39 (2012): 245.
• Knight, Gillian. "Nurse‐led discharge from high dependency unit." Nursing in critical care 8.2 (2003): 56-61.
• McWilliams, Chris, et al. (In press) "Towards a decision support tool for intensive care discharge: machine learning algorithm development using electronic health care data." BMJ Open (2019)
• Kramer, Andrew A., and Jack E. Zimmerman. "A predictive model for the early identification of patients at risk for a prolonged intensive care unit length of stay." BMC medical informatics and decision making 10.1 (2010): 27.
• De Fauw, Jeffrey, et al. "Clinically applicable deep learning for diagnosis and referral in retinal disease." Nature medicine 24.9 (2018): 1342.
• Bejnordi, Babak Ehteshami, et al. "Diagnostic assessment of deep learning algorithms for detection of lymph node metastases in women with breast cancer." Jama 318.22 (2017): 2199-2210.
• Che, Zhengping, et al. "Interpretable deep models for icu outcome prediction." AMIA Annual Symposium Proceedings. Vol. 2016. American Medical Informatics Association, 2016.
• Che, Zhengping, et al. "Recurrent neural networks for multivariate time series with missing values." Scientific reports 8.1 (2018): 6085.

Thanks.

Slides available at test.

image = Image('resources/ebi_logo.png', width=500)
sh = display(image)
image = Image('resources/UoB-colour.png', width=200)
sh = display(image)
image = Image('resources/logo.jpg', width=200)
sh = display(image)